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Abstract 

Sample reuse techniques have significantly reduced the numerical complexity of probabilistic 
robustness analysis. Existing results show that for a nested collection of hyper-spheres the com- 
plexity of the problem of performing N equivalent i.i.d. (identical and independent) experiments 
for each sphere is absolutely bounded, independent of the number of spheres and depending only 
on the initial and final radii. 

In this chapter we elevate sample reuse to a new level of generality and establish that the 
numerical complexity of performing N equivalent i.i.d. experiments for a chain of sets is absolutely 
bounded if the sets are nested. Each set does not even have to be connected, as long as the 
nested property holds. Thus, for example, the result permits the integration of deterministic 
and probabilistic analysis to eliminate regions from an uncertainty set and reduce even further 
the complexity of some problems. With a more general view, the result enables the analysis of 
complex decision problems mixing real- valued and discrete- valued random variables. 



1 Introduction 

The results presented in this chapter evolved from our previous work in probabilistic robustness 
analysis. For completeness we give a brief overview of the problem originally considered and show 
how it is embedded in our present, more general, formulation. 

Probabilistic robust control methods have been proposed with the goal of overcoming the NP hard 
complexity and the conservatism associated with the deterministic worst-case framework of robust 



1 



control (see, [I]-[26] and the references therein). At the heart of the probabihstic control paradigm 
is the idea of sacrificing the extreme instances of uncertainty. This is in sharp contrast to the 
deterministic robust control which approaches the issue of uncertainty with a "worst case" philosophy. 
Due to the obvious possibility of violation of robustness requirements associated with the probabilistic 
method, it has been the common contention that applying the probabilistic method for control design 
may be more dangerous than using the deterministic worst-case approach. Interestingly, it has been 
demonstrated (Chen, Aravena and Zhou, [8]) that it is not uncommon for a probabilistic controller 
(which guarantees only most instances of the uncertainty bounding set assumed in the design) to be 
significantly less risky than a deterministic worst-case controller. The reasons are the "uncertainty 
in modeling uncertainties" and the fact that the worst-case design cannot, in some instances, be 
"all encompassing." Although this philosophy is proposed in the context of robust design, a direct 
consequence on robustness analysis is that it is not necessary to evaluate the system robustness in a 
deterministic worst-case framework. This is because a system certified to be robust in a deterministic 
worst-case framework is not necessarily less risky than a system with a probability that the robustness 
requirement is not always satisfied. 

While the worst-case control theory uses the deterministic robustness margin to evaluate the sys- 
tem robustness, probabilistic control theory introduced the robustness function as a tool to measure 
the robustness properties of a control system subject to uncertainties. Such function is defined as 

P(r) = vol{{X G I P is guaranteed for X })/vol{^r) 

where vol(.) is the Lebesgue measure, P denotes the robustness requirement, and denotes the un- 
certainty bounding set with radius r. This function describes quantitatively the relationship between 
the proportion of systems guaranteeing the robustness requirement and the radius of uncertainty set. 
Such a function has been proposed by a number of researchers. For example, Barmish and Lagoa [3] 
have constructed a curve of robustness margin amplification versus risk in a probabilistic setting. 

The so-called robustness function can serve as a guide for control engineers in evaluating the 
robustness of a control system once a controller design is completed. In addition to overcome the 
issues of conservatism and NP complexity of the worst-case robustness analysis, the probabilistic 
robustness analysis based on the robustness function has the following advantages. 

First, the robustness function can address problems which are intractable by deterministic worst- 
case methods. For many real world control problems, robust performance is more appropriately 
captured by multiple objectives such as stability, transient response (specified, for example, in terms 
of overshoot, rise time and settling time), disturbance rejection measured by i?oo or H2 norm, etc. 
Thus, for a more insightful analysis of the robust performance of uncertain systems, the robustness 
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requirement is usually multi-objective. The complexity of such robustness requirement can easily 
make the robustness problems intractable by the deterministic worst-case methods. For example, 
existing methods fail to solve robustness analysis problems when the robustness requirement is a 
combination of i?oo norm bound and stability. However, the robustness curve can still be constructed 
and provides sufficient insights on the robustness of the system. 

Second, the probability that the robustness requirement is guaranteed can be inferred from the 
robustness function, while the deterministic margin has no relationship to such probability. Based on 
the assumption that the density function of uncertainty is radially symmetric and non-increasing with 
respect to the norm of uncertainty, it has been shown in [2] that the probability that P is guaranteed 
is no less than infpg(o,r] ^(p) when the uncertainty is contained in a bounding set with radius r. The 
underlying assumption is in agreement with conventional modeling and manufacturing practices that 
consider uncertainty as unstructured, with all directions equally likely, and make small perturbations 
more likely than large perturbations. It was discovered in [2] that the robustness function is not 
monotonically decreasing. Hence, the lower bound of the probability depends on P(p) for all p G (0, r]. 
At the first glance, it may seem difficult or infeasible to estimate inf^g^Q P(p) since the estimation 
of F(/9) for every p relies on the Monte Carlo simulation. For such probabilistic method to overcome 
the NP hard of worst-case methods, it is necessary to show that the complexity for estimating 
iiifpe(0,r] foi' ^ given r is polynomial in terms of computer running time and memory space. 
Recently, sample reuse techniques have been developed in [71 El [TO] and it is demonstrated that the 
complexity in terms of space and time is surprisingly low and is linear in the uncertainty dimension 
and the logarithm of the relative width of the range of uncertainty radius. 

Third, using the robustness function for the evaluation of the system robustness allows the de- 
signer to make more accurate statements than using just the robustness margins. Here, by robustness 
margins, we mean both the deterministic robustness margin and its risk-adjusted version - the prob- 
abilistic robustness margin, defined as ps = sup{r | P(r) > 1 — e}. For virtually all practical systems, 
the deterministic robustness margin can be viewed as a special case of the probabilistic robustness 
margin with e = 0. This property should not be confused with the numerical accuracy in evalu- 
ating margins nor with the issue of conservatism. The fundamental reason is the lack of information 
that can be available from the robustness margins. It has been demonstrated in [21 |TO] that both the 
deterministic and probabilistic robustness margins have inherent limitations. In other words, using 
/9j as a measure of robustness can be misleading. Figure [1] shows the conceptual robustness functions 
for two controllers. From the figure it is apparent that the robustness margin with e G [0,0.005], 
p^, for controller A is much larger than the corresponding value, pf , for controller B. Then, based 
on the comparison of ps, control systems A is certainly more robust and should be recommended 
for safety purposes. However, if the coverage probability of the uncertainty set =^pA is low and the 
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Figure 1: Comparison of Controller Alternatives 

robustness curve (i.e, the graphical representation of the robustness function) of control system A 
rolls off rapidly beyond p^, then the robustness of system A may be poor. On the other hand, if the 
robustness curve of control system B maintains a high level for a wide range of uncertainty radius, 
then control system B may be actually more robust than system A. 

In general, the evaluation of the robustness function requires extensive Monte Carlo simulations. 
In applications, many iterations of robust design and analysis may be needed in the development 
of a satisfactory control system, it is therefore crucial to improve the efficiency of estimating the 
robustness function. Complexity has been reduced by considering models for the uncertainties that 
depend on a single "uncertainty radius." In this case, the formal evaluation of the robustness 
function requires A^, i.i.d. uncertain parameter selections for each of a sequence ^ r2 <C • • • ^ 
of uncertainty radii, which is still a daunting task. The sample reuse principle allows carrying the 
evaluation to any degree of accuracy and with absolute bounds in complexity (see, (Tj \9\ flO])- 

The use of uncertainty bounding sets with a given radius can still be viewed as a limitation since 
one may have to include situations that never arise in practice. This is the limitation addressed in this 
work. Moreover, we cast to result as a general problem in decision-making under uncertainties. We 
show that the sample reuse principle can be applied with equal effectiveness in a much more general 
scenario. We shall be concerned with an arbitrary sequence of nested sets C ^2 C • • • C 
where we need to perform N experiments for elements uniformly and independently drawn from each 
set. For each element it is necessary to verify if a certain statement P is true or not. 

The idea of the sample reuse principle is to start experiments from the largest set and if it 
also belongs to smaller subset the experimental result is saved for later use in the smaller set. 
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The experimental result that can be saved includes not only the samples from the sets but also the 
outcome of the evaluation of the statement P. We note that this formulation enables the efficient use 
of Monte Carlo simulations for the evaluation of multi-dimensional distributions and the combination 
of continuous and discrete variables. 

2 Absolute Bound of Complexity 

Consider a sequence of nested sets C ^2 C • • • C ^m- If one needs to perform N experiments 
from each set, a conventional approach would require a total of Nm experiments. However, due to 
sample reuse, the actual number of experiments for set is a random number rij, which is usually 
less than N. Our main result, which depends only on the nested property, shows that this strategy 
saves a significant amount of experimental or computational effort. 

Theorem 1 Let T^in and T^nax be constants such that < Imin < ^lax < 00. For an arbitrary 
sequence of nested sets ^i, i = 1, ■ ■ ■ ,m such that S§\ C =^2 C • • • C cmd Vmin < vol(^i) < 
vol(,^m) ^ ^ax) the expected total number of experiments, n, to obtain N experiments for each set 
is absolutely bounded, independent of the number, m, of sets in the chain and given by 



where E[.] denotes the expectation of a random variable. 

Remark 1 The fact that the result is independent of the number of sets in the nested chain may 
appear surprising but it is a direct consequence of the power of the sample reuse principle. Loosely 
speaking, the more sets are there in the chain, the more chances that an experiment can be reused. In 
fact this characteristic makes the result especially powerful when the demands for accuracy, indicated 
by a large number of sets, is high. 

As a special case of Theorem [H we have the following result, reported by Chen, Zhou, Aravena 
O [To] and presented here now as a corollary to our main result. 

Corollary 1 Let rmin (md rmax be constants such that < rmin < '"max < 00. Let Br denote the 
uncertainty bounding sets with radius r. Suppose that vol{Br) = r'^vol{Bi) for any radius r. Then, 
for any sequence of radius ri < r2 < ■ ■ ■ < r„i such that rmin ti < r„i < ?"max; 
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2.1 Observations about the result 



In the result presented here, the only requirement for the uncertainty sets is that they must be nested. 
This is in sharp contrast to the existing model of uncertainty wherein we define an uncertainty 
"radius" and larger uncertainty sets are simply amplified versions of the smaller sets, defining a 
chain of sets of essentially the same shape. Such limitation is completely eliminated now. 

Another significant feature of the new result is that the uncertainty sets can have "holes" in 
them; i.e., one can easily eliminate situations, or values, that cannot physically take place. In a later 
section we examine this option in more detail and show the advantage provided by the general result. 

In fact, as long as the sets are nested, the sets don't even have to be connected. This permits 
modeling of situations that were not feasible, for example, combination of discrete and continuous- 
valued random variables. 

Finally, the power of the result lies in the efficient use of experiments. The property that is being 
tested is not germane to the result. In this sense, we have provided a tool for decision making in 
complex environments. 

3 Proof of Main Theorem 

This section provides a formal proof of our main result. First we establish some preliminary results 
that will be needed in the proof. 

Lemma 1 For i = 2, . . . ,m, 



where Vj = vol(=^j), j = 1, • • • , m. 
Proof. 

Let m > j > i > 2. Let q^^cf' , . . . , g"^ be the samples generated from i^j. For I = 1, . . . , n^. 




define random variable 



such that 
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if fall in 
otherwise. 



Based on the principle of sample reuse, we have 



m rife 



nm = N, 



j = !,■■■ ,m - 1 



k=j+i e=i 



6 



which imphes that the value of nj depends only on the samples generated from sets ,^k, J + 1 < ^ < 
m. Hence, event {nj = n} is independent of event {Xj = 1}. It follows that 

Pr {Xl_, = 1, n,- = n] = Pr = l} Pr {n,- = n} 

where Pr{.} denotes the probability of an event. Recall that is a random variable with uniform 
distribution over we have 



By the principle of sample reuse, 



Vi-l 



1, 



,iV. 



j=i 1=1 



Thus for i = 2, . . . ,m, 



E[n 



=1 



m N n 



j=i n=l £=1 
m N n 

^ - E E E {4^-1 = i} = ^} 

j=i n=l £=1 
m N . X 

^-EEM^)p^K = -i 

j=j n=l ^ J / 

^-E(^)E"PrK = -} 

T=7 ^ J 



□ 



This result gives the expected number of experiments for a set, in terms of the expected 

values for all the sets that contain it. The recursion can be solved as follows: Since all the experiments 
must belong to the set ^^^^ we have E[nm] = N , now for i < m we can write 



E[n,] = iV_ (^] E[„,] 



E 



+1 ^ 



E [rij] = iV - E [rii] 
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and 



m 



j=i + l 

--(^)-n-(^)e(S)^>"- 

j=l+l 



•"J 



Therefore, 



E[ni„i] = AT- ( !^)E[n,]- ) [iV-E[n,]] 

AT _ ( !^ ) AT. 



Thus we have established 

Lemma 2 Under the sample reuse principle, for an arbitrary sequence of nested sets ^i, i = 
1, • • • ,171 such that C ^2 C ••• C CLnd < vol(^i) < vol(=^m.) < cxo, t/ie expected total 
number of experiments, E [rij], to obtain N experiments for the set SSi is 

E(ni) = iV - -^iV; i = 1,2, . . . ,m - 1. 

Vi+l 

Remark 2 We note that if we use the convention Vm+i = 00 then the previous expression can be 
made valid for i = m. 

Once more one can see the power of the sample reuse principle. If any two sets in the chain are 
"very similar, " then most of the experiments for the larger set can be reused. 

Now we estabhsh a basic inequahty that will be used to prove the main result. 
Lemma 3 For any x > 1, 



Proof. Let 
Then /(I) = 1 and 



- + Inx > 1. 

X 



f{x) = — + Inx. 
x 



^-^>0, Vx>L 



dx x^ 

It follows that /(x) > 1, Vx > 1. □ 
Using the previous result now we can prove 
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Lemma 4 For an arbitrary sequence of numbers < ri < r2 < ■ ■ ■ < r^, 

m—l 



m 



Proof. 

Observing that 



"TT 



m—l 



we have 



Therefore, 



In 



n 



i=l 



m—l 



ri 



m—l 



^ ri+1 V ri 



i=l 



m—l 

E 

i=l 



ri+1 



+ hi 



ri+i 



Since ^-'^ > 1, i = 1, - ■ ■ , m — 1, it follows from Lemma [3] that 

^ +ln ( ^1 > 1, i = L-- - ,m - L 



ri+i 



Hence, 



The lemma is thus proved. 



m-l , s 

V^+ln(^) 



> m — 1. 



Now we are in the position to prove Theorem [TJ By Lemma [51 we have 



E[n] = E 



i=l 
m—l 

i=l 

Nm - N "Y 



N -N 



Vi+l 



m—l 



i=l 



Vi+l 



Therefore, by Lemma HI 



□ 



E 



n 

N 



m—l 



m 



V^<l + ln 
^ Vi+l V ^1 



i=l 



< ( 1 + In ^'""^ 



Vrr 



and thus the proof of Theorem [T] is completed. 
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4 Combination with Deterministic Methods 



In this section we demonstrate the flexibihty allowed by the general nested conditions by examining a 
situation that could not be properly handled with existing tools. Especially, we consider uncertainty 
sets where, for example by deterministic analysis, one can establish subsets that are not feasible; i.e., 
the uncertainty set has "holes" in it. 

There exist rich results for computing the exact or conservative bounds of the robustness margins, 
e.g., structure singular value ^ theory or Kharitonov type methods. Let Sr be a hyper-sphere with 
radius r. Suppose the robustness requirement is satisfied for the nominal system. By the deterministic 
approach, in some situations, it may be possible to determine tq such that the robustness requirement 
is satisfied for S'^q. Then, to estimate 

vol({g € S'r I P is guaranteed for g}) 



(r) 



Vol(5r 



for ri < r2 < ■ ■ ■ < rm with ri > tq, we can apply the sample reuse techniques over a nested chain 
of "donut" sets Di d D2 C ■ ■ ■ <Z with 



Di — Sn \ SrQ, i — 1, ' 



, m 



where "\" denotes the operation of set minus. Instead of directly estimate P(?'j), we can estimate 

vol({g G I P is guaranteed for q}) 

and obtain 

p. ^ _ Pi VOI(A) +vol(5'r.o) 

vol(S',.J 

Let Pi be the estimate of pj. It can be shown that 

vol (A) + vo^Sro) 



1, • • • ,m. 



and 



where 



E 



E 

Vol[Sr 

Pi vol(A) + vo^S",.;,) 



vol(5^J 



Fin) 



Fin) 



(1 - pi)pi\'i 

N 



A,, 



vol(A 



1, • • • ,m. 



If we obtain an estimate P(rj) of P(rj) without applying any deterministic technique, then 



E[P(ri) - P(r,)] 



2 _ (1 - Pi)Ai[l - (1 - Pi)Ai] 



N 



It can be shown that, the ratio of variance of the two estimate is 

2 

Pi^i 



E 



Pi Vol(Di)+Vol(Sro) 

vol(S,J 



E[F{ri) - P(ri)]2 



1 - (1 - pi)Xt 



< 1. 
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This implies that, for the same sample size A^, the estimation can be more accurate when combining 
the deterministic results and the probabilistic techniques. Since the accuracy is exchangeable with 
the computational effort, we can conclude that the computational effort can be reduced by blending 
the power of deterministic methods and randomized algorithms with the sample reuse mechanism. 

5 Conclusions 

Sample reuse has made possible the evaluation of robustness functions with, essentially, arbitrary 
accuracy and bounded complexity. In this work we have expanded the power of the sample reuse 
concept and shown that it can be applied to the evaluation of complex decision problem with the 
only requirement that the uncertainty sets be nested. We have demonstrated the power of the 
generalization by integrating deterministic analysis and randomized algorithms and showing that one 
can develop even more efficient computational approaches for the evaluation of robustness functions. 
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